Information processing apparatus, method, and program

ABSTRACT

An information processing apparatus includes a designation unit which designates an object, a sensing unit which senses a change which exceeds a threshold value in at least a part of the object when a user zooms in on the object, and a zoom unit which zooms in on the object at the zoom rate which is just less than that when there is a change that exceeds the threshold value in at least a part of the object if there is a change that exceeds the threshold value in at least a part of the object when the user zooms in on the object at the designated zoom rate, and which zooms in on the object if there is no change that exceeds the threshold value in at least a part of the object even when the user zooms in on the object at the designated zoom rate.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.12/758,104, entitled “INFORMATION PROCESSING APPARATUS, METHOD ANDPROGRAM,” filed Apr. 12, 2010, which claims priority to Japanese PatentApplication No. 2009-103828, filed Apr. 22, 2009. Each of the documentslisted above is incorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an information processing apparatus,method, and a program. In particular, the present invention relates toan information processing apparatus and method, and a program which makeit possible to quickly zoom in on an object.

2. Description of the Related Art

Recently, personal computers have spread, and many users use personalcomputers. Users can enjoy various kinds of information through theInternet by using personal computers.

Various kinds of information can be displayed on a display. In the caseof a touch panel type display, a manipulation screen is displayed, andby selectively manipulating a specified button on the manipulationscreen, a user can execute a function allocated to the button.

However, a display for displaying information may have various sizes. Ifa manipulation screen, which is adopted to be displayed on a largedisplay, is displayed on a small display with the same layout, thebuttons on the manipulation screen becomes small. If the button is toosmall in comparison to a finger, it is difficult for a user toaccurately select and manipulate a desired button.

Accordingly, Japanese Unexamined Patent Application Publication No.2006-260021 discloses that a lower limit value of the button size ispredetermined in order to prevent the buttons from becoming too small sothat it is difficult for a user to manipulate the buttons with his/herfinger. That is, in the case of a small display, as the size of thebutton is below the lower limit value, the layout of the manipulationscreen is changed to be different from that of a large display.

As described above, even if the lower limit is predetermined, it may notcope with diverse users' tastes. That is, in general, the size of thedisplay of a device that a user uses is fixed and thus is not changed.As a result, according to the previous proposals, the button size ismaintained to be constant to a user.

SUMMARY OF THE INVENTION

However, tastes for the size of an object that is represented by abutton may differ for each user. Since an aged person wants to enlargecharacters that are displayed on the object, he/she is apt to likelarge-sized buttons. In contrast, a young person is apt to like smallobjects in a state in which characters and objects are displayed with agood balance rather than the size of the characters. Accordingly, inorder to change the size of an object to suit a user's taste, installingof a zoom function to enlarge or reduce the size of the object is oftenused.

However, if a user zooms in on the object at an arbitrary zoom rate, itmay be difficult for the user to visually recognize information that isdisplayed on the object. Accordingly, the user may repeat manipulationsfor zooming while setting the predetermined zoom rate and for confirmingwhether the information can be visually recognized. Consequently, it maytake time to set a proper zoom rate and to zoom in on the object at theset zoom rate.

In view of the above situation, it is desirable to make it possible toquickly zoom in on an object.

According to an embodiment of the present invention, there is providedan information processing apparatus including: a designation unit whichdesignates an object; a sensing unit which senses the occurrence of achange, which exceeds a threshold value in at least a part of the objectwhen the user zooms in on the object at a zoom rate designated by auser; and a zoom unit which zooms in on the object at the zoom ratewhich is just less than that when there is a change that exceeds thethreshold value in at least a part of the object if there is a changethat exceeds the threshold value in at least a part of the object whenuser zooms in on the object at the designated zoom rate, and which zoomsin on the object at the designated zoom rate if there is no change thatexceeds the threshold value in at least a part of the object even whenthe user zooms in on the object at the designated zoom rate.

In the image processing apparatus according to the embodiment of thepresent invention, the zoom rate is designated by a remote controlsignal generated when an input device is manipulated using gestures in athree-dimensional (3D) space.

In the image processing apparatus according to the embodiment of thepresent invention, the change, which exceeds the threshold value in atleast a part of the object, can blur or make a mosaic pattern of theobject.

In the image processing apparatus according to the embodiment of thepresent invention, the zoom rate, which is just less than that when theobject is blurred or made into a mosaic pattern, is set by recognizing acharacter, a figure, or a face that is displayed on the object.

The image processing apparatus according to the embodiment of thepresent invention may further include a detection unit which detects thegesture manipulation of the input device; and an operation unit whichoperates the zoom rate on the basis of the detected gesturemanipulation.

In the image processing apparatus according to the embodiment of thepresent invention, if a reference point to be zoomed on the object isdesignated, the zoom unit zooms in on a predetermined range on the basisof a virtual point on a virtual plane to which the reference pointcorresponds.

In the image processing apparatus according to the embodiment of thepresent invention, if end portions in the upward, downward, left, andright directions of an enlarged range are positioned out of the virtualplane when the predetermined range around the virtual point is enlarged,the position of the virtual point in the virtual plane is corrected sothat an image in the virtual plane is enlarged.

According to another embodiment of the present invention, there isprovided an information processing method including the steps of:providing a designation unit, a sensing unit, and a zoom unit;designating an object by the designation unit; sensing by the sensingunit, a change which exceeds a threshold value in at least a part of theobject when the user zooms in on the object at a zoom rate designated bya user; and zooming in on the object using the zoom unit at the zoomrate which is just less than that when there is a change that exceedsthe threshold value occurs in at least a part of the object if there isa change that exceeds the threshold value in at least a part of theobject when the user zooms in on the object at the designated zoom rate,and zooming in on the object by the zoom unit at the designated zoomrate if there is no change that exceeds the threshold value does notoccur in at least a part of the object even when the user zooms in onthe object at the designated zoom rate.

According to still another embodiment of the present invention, there isprovided a program prompting a computer to function as: designationmeans for designating an object; sensing means for sensing a changewhich exceeds a threshold value in at least a part of the object whenthe user zooms in on the object at a zoom rate designated by a user; andzoom means for zooming in on the object at the zoom rate which is justless than that when there is a change that exceeds the threshold valuein at least a part of the object if there is a change that exceeds thethreshold value in at least a part of the object when the user zooms inon the object at the designated zoom rate, and zooming in on the objectat the designated zoom rate if there is no change that exceeds thethreshold value in at least a part of the object even when the userzooms in on the object at the designated zoom rate.

According to the embodiment of the present invention, a designation unitor designation means designates an object, and a sensing unit or sensingmeans senses a change, which exceeds a threshold value in at least apart of the object when the user zooms in on the object at a zoom ratedesignated by a user. A zoom unit or zoom means zooms, if the changethat exceeds the threshold value occurs in at least a part of the objectwhen the user zooms in on the object at the designated zoom rate, in onthe object at the zoom rate which is just less than that when there is achange that exceeds the threshold value in at least a part of the objector zooms, if there is no change that exceeds the threshold value in atleast a part of the object even when the user zooms in on the object atthe designated zoom rate, in on the object at the designated zoom rate.

As described above, according to the embodiment of the presentinvention, an object can be quickly zoomed.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating the configuration of aninformation processing system according to an embodiment of the presentinvention;

FIG. 2 is a perspective view illustrating the configuration of an inputdevice;

FIG. 3 is a block diagram illustrating the functional configuration ofan operation unit of the input device;

FIG. 4 is a block diagram illustrating the functional configuration ofan operation unit of an image display apparatus;

FIG. 5 is a flowchart illustrating the command transmission processing;

FIG. 6 is a flowchart illustrating object zoom processing;

FIG. 7 is a diagram illustrating a display example of an object;

FIG. 8 is a diagram illustrating a first gesture;

FIG. 9 is a diagram illustrating a second gesture;

FIG. 10 is a diagram illustrating a third gesture;

FIGS. 11A and 11B are diagrams illustrating another gesture;

FIG. 12 is a diagram illustrating another gesture;

FIG. 13 is a flowchart illustrating object zoom processing;

FIG. 14 is a flowchart illustrating the EPG display processing;

FIG. 15 is a flowchart illustrating the EPG display processing;

FIG. 16 is a diagram illustrating a zoom point;

FIG. 17 is a diagram illustrating a virtual plane and a display range;

FIG. 18 is a diagram illustrating a zoom point;

FIG. 19 is a diagram illustrating a virtual plane and a display range;

FIG. 20 is a diagram illustrating a zoom point;

FIG. 21 is a diagram illustrating a virtual plane and a display range;

FIG. 22 is a diagram illustrating a display example;

FIG. 23 is a diagram illustrating a display example;

FIG. 24 is a diagram illustrating a display example; and

FIG. 25 is a diagram illustrating a display example;

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, best modes (hereinafter, referred to as embodiments) forcarrying out the present invention will be described. In addition, theexplanation will be made in the following order.

1. First embodiment (configuration of a system)

2. First embodiment (configuration of an input device)

3. First embodiment (functional configuration of an operation unit of aninput device)

4. First embodiment (functional configuration of an operation unit of animage display apparatus)

5. First embodiment (command transmission processing)

6. First embodiment (object zoom processing 1)

7. Second embodiment (object zoom processing 2)

8. Third embodiment (EPG display processing)

9. Modifications

First Embodiment Configuration of a System

FIG. 1 shows the configuration of an information processing systemaccording to an embodiment of the present invention.

An information processing system 1 includes an image display apparatus12 as an information processing apparatus and an input device 11 as apointing device or remote controller which performs remote control ofthe image display apparatus.

The input device 11 includes an acceleration sensor 31, an angularvelocity sensor 32, buttons 33, an operation unit 34, a communicationunit 35, and an antenna 36.

The input device 11 is a so-called air remote controller. Theacceleration sensor 31 and the angular velocity sensor 32 detectacceleration and an angular velocity of the input device 11,respectively, when the input device 11 is manipulated in an arbitrarydirection in a three-dimensional (3D) space.

The buttons 33 are manipulated by a user. Although one button 33 isillustrated in the drawing, a plurality of buttons are actuallyprovided. For example, the buttons 33 includes determination buttonsthat are manipulated when selection is confirmed, and ten keyscorresponding to numerals.

For example, the operation unit 34 composed of a microprocessor and thelike detects results of manipulation of the acceleration sensor 31, theangular velocity sensor 32, and the buttons 33. Signals of command andthe like that correspond to the results of detection are amplified andmodulated by the communication unit 35, and then transmitted as a radiowave to the image display apparatus 12 through the antenna 36.

For example, the image display apparatus 12 composed of a televisionreceiver includes an antenna 51, a communication unit 52, an operationunit 53, and a display unit 54.

The antenna 51 receives the radio wave from the input device 11. Thecommunication unit 52 amplifies and demodulates the signal receivedthrough the antenna 51. For example, the operation unit 53 which iscomposed of a microcomputer and the like performs a predeterminedoperation on the basis of the signal output from the communication unit52. The display unit 54 displays an image. Although not illustrated, theimage display apparatus 12 functions to receive and display a televisionbroadcasting signal on the display unit 54.

Also, the input device 11 may be communicated with image displayapparatus 12 by air, or infrared rays may be used as a medium for thecommunication therebetween.

[Configuration of an Input Device]

FIG. 2 shows the configuration of the external appearance of the inputdevice. The input device 11 has a main body 41 as a manipulation unitwhich is manipulated by a user in order to generate a remotemanipulation signal for controlling the image display apparatus 12 asthe information processing apparatus. On an upper surface of the mainbody 41, although one button 33 is representatively illustrated, aplurality of buttons are actually installed.

The user holds the input device 11, i.e. the main body 41, in one hand,and manipulates the input device in an arbitrary direction in athree-dimensional space or manipulates the buttons 33 in a state inwhich the front of the input device 11 faces the image display apparatus12. Accordingly, it is possible to move a pointer in a manipulationdirection, to set a predetermined mode, and to instruct a predeterminedoperation.

At the front of the input device 11, the acceleration sensor 31 and theangular velocity sensor 32, which are manufactured by the technique ofMEMS (Micro Electro Mechanical Systems), are attached. X″, Y″, and Z″are axes of the acceleration sensor 31 which are perpendicular to oneanother in a relative coordinate system, and X′, Y′, and Z′ are axes ofthe angular velocity sensor 32 which are perpendicular to one another inthe relative coordinate system. The X″, Y″, and Z″ axes are parallel tothe X′, Y′, and Z′ axes, respectively. X, Y, and Z are axes which areperpendicular to one another in an absolute coordinate system. The Yaxis is an axis in a vertical direction, and the X and Z axes are axesin a horizontal plane. The Y axis is an axis in the vertical directionwhich is perpendicular to the horizontal plane.

The entire main body 41 is manipulated in an arbitrary direction in athree-dimensional space by the user typically in a state in which thefront (i.e. upper right end in FIG. 2) of the main body 41 faces thedisplay unit 54 of the image display apparatus 12 that is located beforethe main body. In this case, the angular velocity sensor 32 which is abiaxial oscillation type angular velocity sensor detects the angularvelocities of the pitch angle θ and the yaw angle ψ rotating around apitch rotation axis and a yaw rotation axis which are parallel to the X′and Y′ axes, respectively. An earth magnetic type angular velocitysensor may be used instead of the oscillation type angular velocitysensor. The acceleration sensor 31 detects the acceleration Ax(t) andAy(t) in the X″ and Y″ directions. The acceleration sensor 31 can detectthe acceleration as vector quantity. As the acceleration sensor 31, itis also possible to use a triaxial acceleration sensor which has threeaxes of X″, Y″, and Z″ axes as sensitivity axes.

A user manipulates the entire input device 11 in the arbitrary directionin the three-dimensional free space while holding the input device 11with one hand. The input device 11, which is a so-called air remotecontroller, is not used in a state in which it is put on a desk, but ismanipulated in the air. The input device 11 detects the manipulationdirection and outputs a manipulation signal corresponding to themanipulation direction. In addition, the input device 11 outputs acorresponding manipulation signal when the buttons 33 are manipulated.

[Functional Configuration of an Operation Unit of an Input Device]

FIG. 3 shows the functional configuration of an operation unit 34 of theinput device 11. The operation unit 34 includes an acquisition unit 101and a transmission unit 102.

The acquisition unit 101 acquires button information corresponding to amanipulated button in addition to the angular velocity or theacceleration. The transmission unit 102 transmits a command based on theacquired information to the image display apparatus 12.

[Functional Configuration of an Operation Unit of an Image DisplayApparatus]

FIG. 4 shows the functional configuration of an operation unit 53 of theimage display unit 12. The operation unit 53 includes a designation unit201, a setting unit 202, a detection unit 203, an operation unit 204, adetermination unit 205, a sensing unit 206, a zoom unit 207, anacquisition unit 208, an extraction unit 209, and an execution unit 210.

The designation unit 201 designates an object. The setting unit 202 setsa mode. The detection unit 203 detects zoom manipulation. The operationunit 204 operates the zoom rate. The determination unit 205 performsvarious kinds of determination. The sensing unit 206 senses a defect indisplay information. The zoom unit 207 zooms in on the object. Theacquisition unit 208 acquires the display condition of the displayinformation. The extraction unit 209 extracts a region of a virtualplane. The execution unit 210 executes the processing that correspondsto the object.

[Command Transmission Processing]

FIG. 5 is a flowchart illustrating the command transmission processingof an input device 11. Hereinafter, with reference to FIG. 5, thecommand transmission processing of the input device 11 will bedescribed.

In step S1, the acquisition unit 101 acquires a manipulation amount.Specifically, it acquires detection outputs of the acceleration sensor31 and the angular velocity sensor 32, and button information based onthe manipulation of the buttons 33.

That is, the angular velocity sensor 32 outputs the angular velocity(ωψ(t), ωθ(t)) around Y′ axis and X′ axis of motion occurring when auser holds and manipulates the input device 11 in the three-dimensionalfree space. In the same manner, the acceleration sensor 31 outputsacceleration (Ax(t), Ay(t)) of X″ axis and Y″ axis of motion occurringwhen a user holds and manipulates the input device 11 in thethree-dimensional free space. The acquisition unit 101 acquires thedetected angular velocity (ωψ(t), ωθ(t)) and acceleration (Ax(t),Ay(t)). Specifically, the angular velocity (ωψ(t), ωθ(t)) and theacceleration (Ax(t), Ay(t)) are analog-to-digital (A/D) converted by andstored in an analog-to-digital (A/D) converter built in the operationunit 34.

Then, in step S2, the transmission unit 102 transmits a command based onthe result of acquisition in step S1. Specifically, the command ismodulated by the communication unit 35, and transmitted as a radio waveto the image display apparatus 12 through the antenna 36.

In this case, it is not necessary that the command is the form of acommand, and it may be information that can support the image displayapparatus 12 in performing a predetermined processing.

By repeating the above-described process, a predetermined commandprovided from the input device 11 is transmitted to the image displayapparatus 12 on the basis of the user's manipulation.

Object Zoom Processing 1

If the command is transmitted from the input device 11 through theprocessing illustrated in FIG. 5, the antenna 51 of the image displayapparatus 12 receives the corresponding radio wave. The communicationunit 52 demodulates the command received through the antenna 51 andsupplies the demodulated command to the operation unit 53. Theacquisition unit 208 of the operation unit 53 acquires the transmittedcommand. The execution unit 210 executes the corresponding process onthe basis of the command. For example, if the user instructs the zoomingin on an object, the processing of zooming in on an object is executed.

FIG. 6 is a flowchart illustrating the processing of zooming in on anobject executed by the image display apparatus 12. Hereinafter, withreference to FIG. 6, the process of designating the predetermined objectand zooming in on the object will be described.

In step S21, the designation unit 201 designates the object. That is, inthe case of zooming in on the object displayed on the display unit 54,the user designates the object to be zoomed in on by manipulating theinput device 11. Specifically, in a pointing mode, a predeterminedobject is designated by the pointer. If a remote control signal based onthis manipulation is received, the designated object becomes the targetof zooming.

FIG. 7 shows a display example of an object. As illustrated in FIG. 7,in a state in which an arbitrary number of objects 251 are displayed onthe display unit 54, the user designates the object to be zoomed in onby using the pointer 301. For example, as shown in FIG. 7, an object 251indicated as a triangle is designated.

After the object to be zoomed in on is designated, the user performsgesture manipulation for setting a zoom mode by holding the input device11 with one hand.

FIG. 8 shows a gesture for setting a zoom mode. When setting the zoommode, the user performs the first gesture manipulation. The firstgesture is illustrated in FIG. 8. That is, the input device 11 is firstin a horizontal position (i.e. a position indicated by a referencenumeral 11H) in which the front of the input device 11 faces upward.From this state, the input device 11 is rotated around an axis 11S thatis perpendicular to an axis 11L in a length direction so that the inputdevice 11 is in a vertical position (i.e. a position indicated by areference numeral 11V) in which the front of the input device 11 facesthe user and the front end of the input device 11 faces upward. If aremote control signal that corresponds to the first gesture is received,the setting unit 202 sets a zoom mode in step S22. When the zoom mode isset, the previous mode, e.g. the pointing mode, is cancelled.

The angle α of the axis 11L in a length direction of the input device 11against the Y axis may be determined from the size of the accelerationAz(t) in Z″-axis direction as illustrated in FIG. 2. If the angle αagainst the Y axis is within a predetermined threshold value (e.g.) 10°,it is determined that the input device 11 is in a vertical position inwhich the input device faces upward. For example, if a differencebetween the acceleration Az(t) and the gravitational acceleration g isequal to or less than the threshold value, i.e. if the accelerationAz(t) is almost the same as the gravitational acceleration g, it can bedetermined that the input device 11 is in a vertical position in whichit faces upward.

Of course, the decision of the positioning may be made using othervarious kinds of information transmitted by the processing in step S2 asshown in FIG. 5.

If the input device 11 is not in a vertical position in which the inputdevice faces upward, i.e. if the angle α is larger than the thresholdvalue, the zoom mode is not set, and the original mode (e.g. thepointing mode) continues.

After the angle α becomes equal to or less than the threshold value andthe zoom mode is set, a user may perform the second gesture manipulationfor zooming in on the screen display. FIG. 9 shows the second gesture.As shown in the same drawing, the second gesture is a manipulation thatmoves the input device 11 in parallel to a position moving close to auser as indicated by a reference numeral 11N or to a position movingaway from the user as indicated by a reference numeral 11F while theinput device 11 is kept in the vertical position in which the inputdevice faces upward. In step S23, the detection unit 203 detects thiszoom manipulation from the remote control signal. That is, the secondgesture manipulation is detected.

In step S24, the operation unit 24 operates the zoom rate on the basisof the remote control signal for the zoom manipulation of the inputdevice 11. The zoom rate, for example, becomes higher as the distance ofthe parallel movement is lengthened, while it becomes lower as thedistance of the parallel movement is shortened as shown in FIG. 9.

In step S25, the determination unit 205 determines whether the zoommanipulation corresponds to enlargement or reduction. If the inputdevice 11 is moved backward, i.e. if the input device is moved in adirection moving closer to the user, it is determined that the zoommanipulation is for reduction. By contrast, if the input device 11 ismoved in a depth direction, i.e. if the input device is moved in adirection moving away from the user, it is determined that the zoommanipulation is for the enlargement. Of course, it is also possible todefine these directions in a reverse manner.

In FIG. 9, if the input device 11 is moved from a position indicated bya reference numeral 11 to a position indicated by a reference numeral11N, i.e. if the input device is moved in a direction moving closer tothe user, the acceleration Ay(t) in the Y″-axis direction in FIG. 2becomes positive (or negative). By contrast, if the input device 11 ismoved in a depth direction (e.g. a direction of the display unit 54),i.e. if the input device is moved in a direction moving away from theuser, the acceleration Ay(t) in the Y″-axis direction becomes negative(or positive). Accordingly, this determination can be made from thepolarity of the acceleration Ay(t).

If the input device 11 is moved backward, the sensing unit 206recognizes the display information and senses its defect in step S26.The defect of the object is a change that exceeds a threshold value inat least a part of the object. For example, blurring of the displayinformation that is displayed on the object is sensed. Specifically, inthe case in which the object is reduced at a zoom rate operated in stepS24, it is sensed whether the display information, such as thecharacter, figure, face image, or the like, that is displayed on theobject is blurred.

In step S27, the determination unit 205 determines whether the displayinformation is blurred on the basis of the result of sensing in stepS26. In the case of a character or a figure, when the number of strokesof a character or a space between lines that indicate a figure becomesequal to or less than a predetermined threshold value, it is determinedthat the display information is blurred. Also, in the case of a faceimage, when the distance of the contour of a predetermined region, suchas a mouth, a nose, or the like, becomes equal to or less than apredetermined threshold value, it is determined that the displayinformation is blurred.

If it is determined that the display information is blurred, theoperation unit 204 increases the zoom rate in step S28. That is, if itis assumed that the size of the object when the object is reduced at thezoom rate ZR₁ operated in step S24 is OS₁, the zoom rate is changed toZR₂(=ZR₁+1) which is larger than ZR₁ by one step so that the object hasa larger size OS₂(>OS₁).

In step S26, the sensing unit 206 senses blurring of the displayinformation in the case in which the object is reduced at the zoom rateZR₂ set in step S28. In step S27, the determination unit 205 determineswhether the display information is blurred on the basis of the result ofthe sensing in step S26.

By repeating the processing in steps S26 to S28, the zoom rate ZR_(A) isobtained which is just less than that when the display information isblurred. Once the zoom rate ZR_(A) is obtained which is just less thanthat when the display information is blurred, the zoom unit 207 zooms inon the designated object at the obtained zoom rate ZR_(A) in step S32.As a result, the user can rapidly make the object into the minimum sizein which the display information being displayed can be confirmed.

If it is determined that the zoom manipulation corresponding to theenlargement has been performed in step S25, i.e. if the input device 11has been moved in a depth direction, the sensing unit 206 recognizes thedisplay information and senses its defect in step S29. Here, a changethat exceeds the threshold value in at least a part of the object issensed as a defect. For example, it is sensed that the displayinformation that is displayed on the object has been made into a mosaicpattern. Specifically, in the case in which the object is enlarged at azoom rate operated in step S24, it is sensed whether the displayinformation, such as the character, figure, face image, or the like,that is displayed on the object has been made into a mosaic pattern.

In step S30, the determination unit 205 determines whether the displayinformation has been made into a mosaic pattern on the basis of theresult of the sensing in step S29. In the case of a character or afigure, when the number of strokes of a character or a line thatindicates a figure becomes a zigzag line, it is determined that thedisplay information has been made into a mosaic pattern. Also, in thecase of a face image, when the line of the contour of a predeterminedregion, such as a mouth, a nose, or the like, becomes a zigzag line, itis determined that the display information has been made into a mosaicpattern.

Although a line is formed by connection of a plurality of pixels, it isrecognized by a user as a natural and smooth continuity in a state inwhich it is not enlarged. Accordingly, in microscopy, i.e. in obtaininga line in the unit of a pixel, any line may be in a zigzag state.However, the term “zigzag” as the basis of determining a mosaicpatterning does not mean such a state that may not be actually observed.

The term “zigzag” as the basis of determining the mosaic patterning maybe the basis that prohibits excessive enlargement which makes itdifficult for a user to recognize a line as a natural and smoothcontinuity. Accordingly, for example, in accordance with the enlargementprocessing, a block is formed by a set of pixels constituting the lineof the contour, a plurality of neighboring pixels having the sameluminance, and a plurality of neighboring pixels having differentluminance which is smaller than a predetermined threshold value. Whenthe length of at least one side of the block becomes larger than thepredetermined threshold value, it may be determined that the displayinformation has been made into a mosaic pattern.

If it is determined that the display information has been made into amosaic pattern, the operation unit 204 reduces the zoom rate in stepS31. That is, if it is assumed that the size of the object when theobject is increased at the zoom rate ZR₁ operated in step S24 is OS₃,the zoom rate is changed to ZR₃(=ZR₁−1) that is smaller than ZR₁ by onestep so that the object has a smaller size OS₄(<OS₃).

In step S29, the sensing unit 206 senses the mosaic patterning of thedisplay information in the case in which the object is enlarged at thezoom rate ZR₃ set in step S31. In step S30, the determination unit 205determines whether the display information has been made into a mosaicpattern on the basis of the result of the sensing in step S29.

By repeating the processing in steps S29 to S31, the zoom rate ZR_(B) isobtained which is just less than that when the display information hasbeen made into a mosaic pattern. Once the zoom rate ZR_(B) is obtainedwhich is just less than that when the display information has been madeinto a mosaic pattern, the zoom unit 207 zooms in on the designatedobject at the obtained zoom rate ZR_(B) in step S32. As a result, theuser can rapidly make the object into the maximum size in which thedisplay information being displayed can be properly confirmed.

In this case, when setting the pointing mode, the user performs thethird gesture manipulation. FIG. 10 shows the third gesture. As shown inthe same drawing, the third gesture is a gesture in which the inputdevice 11 is rotated around an axis 11S that is perpendicular to an axis11L in a length direction of the input device 11 from a verticalposition (i.e. a position indicated by a reference numeral 11V) in whichthe front end of the input device 11 faces upward so that the front ofthe input device 11 faces the user to a horizontal position (i.e. aposition indicated by a reference numeral 11H) in which the front of theinput device 11 faces upward. That is, the third gesture is the oppositeof the first gesture.

If the angle γ against the Z axis is within a predetermined thresholdvalue (e.g. 10°), it is determined that the input device 11 is in ahorizontal position. In other words, if the angle α(=90−γ) between theaxis 11L in the length direction of the input device 11 and the Y axisis equal to or more than 80°, it is determined that the input device 11is in the horizontal position.

The angle γ of the axis 11L in the length direction of the input device11 against the Z axis may be determined from the size of theacceleration Az(t) in the Z″-axis direction as illustrated in FIG. 2.For example, if the acceleration Az(t) in the Z″-axis direction isalmost “0”, i.e. if a component of force of the gravitationalacceleration g in the Z″-axis direction is nearly zero, it is determinedthat the input device 11 is in the horizontal position.

As described above, a user can change the mode by performing the gesturemanipulation so that the position of the input device 11 is changed tobe in a predetermined direction in a three-dimensional space.

In this case, the modes to be controlled are not limited to the pointingmode and the zoom mode. A scroll mode, a channel change/return mode, avolume up/down mode, and other modes may be the subject to control.

Also, the gestures of the input device 11 are not limited to those asillustrated in FIGS. 8 to 10.

FIGS. 11A and 11B show another gesture. As shown in FIGS. 11A and 11B, amanipulation that moves the input device in parallel in left and rightdirection (see FIG. 11A) or in upward and downward direction (see FIG.11B) in a state in which the input device is in a vertical position inwhich the input device faces upward (see FIGS. 11A and 11B) may bedetermined as the second gesture.

FIG. 12 shows still another gesture. As shown in the same drawing, ifthe input device 11 is rotated by 90° in a direction C from a horizontalposition that is the basic gesture indicated by a reference numeral 11to a position in which the front end of the input device faces upward,the input device 11 is in a vertical position in which the input device11 faces upward as indicated by a reference numeral 11C. This gesture isillustrated in FIG. 8.

In addition, if the input device 11 is rotated by 90° in a direction Dfrom a horizontal position to a position in which the front end of theinput device faces downward, the input device 11 is in a verticalposition in which the input device 11 faces downward as indicated by areference numeral 11D.

Also, if the input device 11 is rotated by 90° in a counterclockwisedirection A from a horizontal gesture, the input device 11 is in agesture in which the input device 11 is rotated counterclockwise by 90°as indicated by a reference numeral 11A. If the input device 11 isrotated by 90° in a clockwise direction B from a horizontal gesture, theinput device 11 is in a gesture in which the input device 11 is rotatedclockwise by 90° as indicated by a reference numeral 11B. If the inputdevice 11 is rotated by 180° in a clockwise direction B from ahorizontal gesture, the input device 11 is in a gesture in which theinput device 11 is turned upside down as indicated by a referencenumeral 11E.

The gesture may be determined as the first gesture or the third gesture.

Using these gestures, the same function as described above can beperformed. By combining these gestures as the first to third gestures, auser can perform an intuitive manipulation.

Since the zoom rate is set based on the third gesture manipulation inthe three-dimensional space of the input device 11, it is necessary fora user to finely control the distance by which the input device 11 ismoved forward and backward in order to designate a desired zoom rate.However, such a fine control demands familiarity, and thus it isdifficult for an unfamiliar user to perform such a fine control. As aresult, if an unfamiliar user performs the gesture manipulation, thezoom rate may be set to be extremely high or low. Accordingly, bysetting the zoom rate which is just less than that when there is anoccurrence of blurring or mosaic patterning, it is possible to quicklyset the zoom rate, and thus the manipulability can be improved.

Second Embodiment Object Zoom Processing 2

In the embodiment of FIG. 6, if the display information has a defect,the zoom rate is typically changed. However, the occurrence of somedegree of defect of the display information may be permitted by someusers. In this case, the users may register in advance displayconditions of the display information. If the registered displaycondition does not permit blurring or mosaic patterning of the displayinformation, the same process as that illustrated in FIG. 6 isperformed. However, if the registered display condition permits blurringor mosaic patterning of the display information, the zooming isperformed at a zoom rate designated by the user. Hereinafter, withreference to FIG. 13, the processing of zooming in on an object in thiscase will be described.

FIG. 13 is a flowchart illustrating the processing of zooming in on anobject. The process in steps S61 to S75 in FIG. 13 is basically the sameas the process in steps S21 to S32 in FIG. 6. One difference is that astep S65 is inserted between steps S64 and S66 of FIG. 13 thatcorrespond to steps S24 and S25 of FIG. 6, respectively. Also, anotherdifference is that a step S67 is inserted between steps S66 and S68 ofFIG. 13 that correspond to steps S25 and S26 of FIG. 6, respectively.Also, another difference is that a step S71 is inserted between stepsS66 and S72 of FIG. 13 that correspond to steps S25 and S29 of FIG. 6,respectively.

In FIG. 13, after the zoom rate based on the second gesture manipulationfor the designated object is operated by the processing of steps S61 toS64, the acquisition unit 208 acquires the display condition in stepS65. The display condition is registered in advance by a user, andindicates whether the blurring or mosaic patterning of the displayinformation is prohibited or permitted.

In step S66, the determination unit 205 determines which one ofenlargement and reduction the zoom manipulation detected in step S63,i.e. the second gesture manipulation, corresponds to. If the zoommanipulation for the reduction has been performed, the determinationunit 205 determines whether blurring of the display information has beenprohibited in step S67. This determination is performed based on thedisplay condition acquired in step S65.

If blurring of the display information is prohibited, the processing ofsteps S68 to S70 and step S75 is performed. In this case, the processingis the same as that illustrated in FIG. 6, and the zoom is performed atthe zoom rate which is just less than that when the display informationis blurred.

By contrast, if blurring of the display information is not prohibited,the processing of steps S68 to S70 is not performed, and the processingof step S75 is immediately performed. Accordingly, the zoom is performedat the zoom rate operated in step S64, i.e. at the zoom rate designatedthrough the user's manipulation of the input device 11.

If it is determined that the zoom manipulation corresponding to theenlargement has been performed in step S66, the determination unit 205determines whether the mosaic patterning of the display information isprohibited in step S71. This determination is performed base on thedisplay condition acquired in step S65.

If the mosaic patterning of the display information is prohibited, theprocessing in steps S72 to S75 is performed. In this case, the sameprocessing as that illustrated in FIG. 6 is performed, and the zoom isperformed at a zoom rate which is just less than that when the displayinformation has been made into a mosaic pattern.

By contrast, if the mosaic patterning of the display information is notprohibited, the processing in steps S72 to S74 is not performed, but theprocessing in step S75 is immediately performed. In this case, the zoomis performed at the zoom rate operated in step S64, i.e. at the zoomrate designated through the user's manipulation of the input device 11.

As described above, in the embodiment of the present invention, theuser's intention is preferred, and if the user does not permit blurringor mosaic patterning of the display information, the zoom is performedat the zoom rate which is just less than that when the blurring or themosaic patterning of the display information occurs. By contrast, if theuser permits blurring or mosaic patterning of the display information,the zoom is performed at a zoom rate designated by the user.

Third Embodiment EPG Display Processing

Then, the process of zooming an EPG (Electronic Program Guide) will bedescribed.

FIGS. 14 and 15 are flowcharts illustrating the EPG display processing.Hereinafter, with reference to FIGS. 14 and 15, the EPG displayprocessing will be described.

In the case of manipulating the EPG, in order to set the pointing mode,a user performs the third gesture manipulation as shown in FIG. 10. If aremote control signal that corresponds to this gesture is received, thesetting unit 202 sets the pointing mode in step S201. Accordingly, theuser can designate an arbitrary object by the pointer.

In step S202, the determination unit 205 determines whether a programhas been designated. That is, the user selects a program from a programtable that is displayed by the pointer 301 by manipulating the inputdevice 11. If the program has been designated, the execution unit 210executes the processing that corresponds to the program in step S205.Specifically, the selected program is received, and is displayed on thedisplay unit 54.

If the program has not been designated, the determination unit 205determines whether the zoom point has been pointed in step S203. If thezoom point has not been pointed, the determination unit 205 determineswhether a predetermined time has elapsed, i.e. whether anon-manipulation time has reached a predetermined time, in step S204. Ifthe predetermined time has not elapsed, the processing returns to stepS202, and the subsequent processing is repeated. When the predeterminedtime has elapsed, the processing is ended.

In the case of zooming in on the EPG, the user designates the zoom pointby manipulating the input device 11. The zoom point is a reference pointthat prescribes the range to be zoomed in on. That is, the position ofthe reference to be zoomed in on in a screen of the display unit 54 onwhich the EPG is displayed is designated by the pointer. The designationof the zoom point means that the EPG is designated as the object. If theremote control signal that corresponds to the designation of the zoompoint is received, the setting unit 202 sets the zoom point in stepS206.

Then, the user performs the first gesture manipulation with the inputdevice 11. If a remote control signal that corresponds to the firstgesture is received, the setting unit 202 sets the zoom mode in stepS207. At this time, the pointing mode is cancelled. Further, the userperforms the second gesture manipulation as illustrated in FIG. 9. Instep S208, the detection unit 203 detects the zoom manipulation based onthe second gesture. In step S209, the operation unit 204 operates thezoom rate. That is, the zoom rate is operated based on the secondgesture manipulation detected in step S208.

In step S210, the extraction unit 209 extracts a region of a virtualplane that corresponds to the zoom point. Hereinafter, with reference toFIGS. 16 to 21, the process of extracting the region of the virtualplane will be described.

FIG. 16 shows the zoom point. Although not illustrated for conveniencein explanation, the EPG is displayed on the display unit 54. The zoompoint P₁₁ is designated by the pointer 301. In FIG. 16, the position ofthe zoom point P₁₁ in a horizontal direction is a point at which thedivision ratio of a side in a horizontal direction of the display unit54 is a₁:b₁. Also, the position of the zoom point P₁₁ in a verticaldirection is a point at which the division ratio of a side in a verticaldirection of the display unit 54 is c₁:d₁.

FIG. 17 shows the virtual plane and the extracted region. If the zoompoint P₁₁ is designated as shown in FIG. 16, a predetermined region 312is extracted from a virtual plane 311 as shown in FIG. 17. In FIG. 17,the virtual plane 311 indicates a range in which the EPG virtuallyexists, and the region 312 indicates a range that is displayed on thedisplay unit 54 as a range on the basis of (in this case, around) apoint P₁₂ on the virtual plane 311.

The point P₁₂ that is a virtual point on the virtual plane 311 is apoint that corresponds to the zoom point P₂₂ on the display unit 54, andthe region 312 is a region having a size that corresponds to the displayunit 54 on the basis of the point P₁₂. As shown in FIG. 17, if it isassumed that the point P₁₂ is a point at which the division ratio of aside in a horizontal direction of the virtual plane 311 is A₁:B₁ and atwhich the division ratio of a side in a vertical direction of thevirtual plane is C₁:D₁, the relations between the division ratios areset to A₁:B₁=a₁:b₁, and C₁:D₁=c₁:d₁. That is, the point P₁₂ on thevirtual region 311 is a position that corresponds to the position of thezoom point P₁₁ on the display unit 54.

FIG. 18 shows the zoom point. In an example illustrated in FIG. 18, theposition of the zoom point P₂₁ in a horizontal direction is a point atwhich the division ratio of a side in a horizontal direction of thedisplay unit 54 is a₂:b₂. Also, the position of the zoom point P₂₁ in avertical direction is a point at which the division ratio of a side in avertical direction of the display unit 54 is c₂:d₂.

FIG. 19 shows the virtual plane and the extracted region. If the zoompoint P₂₁ is designated as shown in FIG. 18, a region 312 that is basedon a point P₂₂ corresponding to the zoom point P₂₁ is extracted from avirtual plane 311 as shown in FIG. 19. The point P₂₂ is a point at whichthe division ratio of a side in a horizontal direction of the virtualplane 311 is A₂:B₂ and at which the division ratio of a side in avertical direction of the virtual plane is C₂:D₂. Also, the relationsbetween the division ratios are set to A₂:B₂=a₂:b₂, and C₂:D₂=c₂:d₂.

However, as shown in FIG. 19, a part of the region 312 in the range thatcorresponds to the size of the display unit 54, which is around thepoint P₂₂, is projected to the outside of the virtual plane 311. No EPGexists on the outside of the virtual plane 311. Accordingly, acorrection process is performed with respect to the position in adirection in which the point P₂₂ is projected to the outside so as toprevent the extracted region from being projected from the virtual plane311.

That is, as shown in FIG. 19, the division ratio of a side in a verticaldirection of the point P₂₂ is changed from C₂:D₂ to C₂′:D₂′. As aresult, the point P₂₂ is corrected to a point P₂₂′, and the extractedregion 312 is corrected to a region 312′ which has a size correspondingto the display unit 54 and which is around the point P₂₂′. Accordingly,a side (e.g. an upper side in FIG. 19) in a direction in which theregion 312′ is projected coincides with the upper side of the virtualplane 311, and thus the whole region 312′ becomes a region inside thevirtual plane 311.

FIG. 20 shows the zoom point. In an example as shown in FIG. 20, theposition of the zoom point P₃₁ in a vertical direction is a point atwhich the division ratio of a side in a vertical direction of thedisplay unit 54 is c₃:d₃. Also, the position of the zoom point P₃₁ in ahorizontal direction is a point at which the division ratio of a side ina horizontal direction of the display unit 54 is a₃:b₃.

FIG. 21 shows the virtual plane and the extracted region. If the zoompoint P₃₁ is designated as shown in FIG. 20, a region 312 that is arounda point P₃₂ corresponding to the zoom point P₃₁ is extracted from avirtual plane 311 as shown in FIG. 21. The point P₃₂ is a point at whichthe division ratio of a side in a horizontal direction of the virtualplane 311 is A₃:B₃ and at which the division ratio of a side in avertical direction of the virtual plane is C₃:D₃. Also, the relationsbetween the division ratios are set to A₃:B₃=a₃:b₃, and C₃:D₃=c₃:d₃.

However, as shown in FIG. 21, a part of the region 312 in the range thatcorresponds to the size of the display unit 54, which is around thepoint P₃₂, is projected to the outside of the virtual plane 311.Accordingly, a correction process is performed with respect to theposition in a direction in which the point P₃₂ is projected to theoutside so as to prevent the extracted region from being projected fromthe virtual plane 311.

That is, as shown in FIG. 21, the division ratio of a side in ahorizontal direction of the point P₃₂ is changed from A₃:B₃ to A₃′:B₃′.As a result, the point P₃₂ is corrected to a point P₃₂′, and theextracted region 312 is corrected to a region 312′ which has a sizecorresponding to the display unit 54 and which is around the point P₃₂′.Accordingly, a side (e.g. a right side in FIG. 19) in a direction inwhich the region 312′ is projected coincides with the right side of thevirtual plane 311, and thus the whole region 312′ becomes a regioninside the virtual plane 311.

If the region to be extracted is projected from two sides of the virtualplane 311, correction processes in respective directions are performed.

However, the EPG is displayed on the virtual plane 311, and due to itsproperty, a block composed of a channel and a time zone is provided as aunit. Accordingly, it may be possible that a region in which an integernumber of blocks are arrayed is extracted from at least one of channeland time axes.

Referring again to FIGS. 14 and 15, after the extraction of the regionthat corresponds to the zoom point is performed in step S210, thedetermination unit 205 determines which one of enlargement and reductionthe zoom manipulation corresponds to in step S211. As described above,it is determined which direction between a backward direction and adepth direction the input device 11 has been moved in.

If the input device 11 has been moved backward, i.e. if reduction isinstructed, the sensing unit 206 recognizes the display information andsenses its defect in step S212. In this case, blurring of a character,which is the display information displayed on the object, is sensed.

In step S213, the determination unit 205 determines whether thecharacter as the display information is blurred on the basis of theresult of the sensing in step S212.

If it is determined that the character is blurred, the operation unit204 increases the zoom rate in step S214. That is, if it is assumed thatthe size of the object when the object is reduced at the zoom rate ZR₁operated in step S209 is OS₁, the zoom rate is changed to ZR₂(=ZR₁+1)that is larger than ZR₁ by one step so that the object has a larger sizeOS₂(>OS₁).

In step S212, the sensing unit 206 senses blurring of the character inthe case in which the object is reduced at the zoom rate ZR₂ set in stepS214. In step S213, the determination unit 205 determines whether thecharacter is blurred on the basis of the result of the sensing in stepS212.

By repeating the processing in steps S212 to S214, the zoom rate ZR_(A)is obtained which is just less than that when the character is blurred.Once the zoom rate ZR_(A) is obtained which is just less than that whenthe character is blurred, the zoom unit 207 zooms in on the designatedobject at the obtained zoom rate ZR_(A) in step S218. As a result, theuser can rapidly make the object into the minimum size in which thedisplay information being displayed can be confirmed.

If it is determined that the zoom manipulation corresponding to theenlargement has been performed in step S211, i.e. if the input device 11has been moved in a depth direction, the sensing unit 206 senses thedefect of the display information in step S215. In this case, the mosaicpatterning of the character as the display information that is displayedon the object is sensed.

In step S216, the determination unit 205 determines whether thecharacter has been made into a mosaic pattern on the basis of the resultof the sensing in step S215.

If it is determined that the character has been made into a mosaicpattern, the operation unit 204 reduces the zoom rate in step S217. Thatis, if it is assumed that the size of the object when the object isenlarged at the zoom rate ZR₁ operated in step S209 is OS₃, the zoomrate is changed to ZR₃(=ZR₁−1) that is smaller than ZR₁ by one step sothat the object has a smaller size OS₄(<OS₃).

In step S215, the sensing unit 206 senses the defect of the displayinformation in the case in which the object is enlarged at the zoom rateZR₃ set in step S217. Specifically, the mosaic patterning of thecharacter is sensed. In step S216, the determination unit 205 determineswhether the character has been made into a mosaic pattern on the basisof the result of the sensing in step S215.

By repeating the processing in steps S215 to S217, the zoom rate ZR_(B)is obtained which is just less than that when the character has beenmade into a mosaic pattern. Once the zoom rate ZR_(B) is obtained whichis just less than that when the character has been made into a mosaicpattern, the zoom unit 207 zooms in on the designated object at theobtained zoom rate ZR_(B) in step S218. As a result, the user canrapidly make the object into the maximum size in which the characterbeing displayed can be properly confirmed.

After the processing in step S218, the processing returns to step S202,and the subsequent processes are performed.

FIG. 22 shows a display example of EPG before zooming, and FIG. 23 showsa display example of EPG after zooming.

As shown in FIG. 22, the EPG is displayed on the display unit 54. On anupper side of the screen, in a horizontal direction, televisionbroadcasting channel numbers 1, 3, 4, 6, 8, 10, 12 are displayed. On theleft side of the screen, in a vertical direction, time zones 4:00, 5:00,6:00, . . . , 23:00, 24:00 are displayed. Although not illustrated inthe drawing, in each time zone of each channel, information of thecorresponding programs, such as a title or the like, is displayed.

In FIG. 22, a point at which the pointer 301 is positioned is designatedas a zoom point P₄₁. The zoom point P₄₁ is positioned on the left sideof a block designated by a channel 10 and a time zone of 4:00. In thisstate, if a predetermined amount of zoom manipulation (e.g. enlargementmanipulation) is performed, as shown in FIG. 23, blocks designated bytime zones of 4:00 to 5:00 and channels 8 and 10, respectively, areenlarged and displayed. That is, information on a program that isbroadcast at channel 8 in a time zone of 4:00 and information on aprogram that is broadcast at channel 10 in a time zone of 4:00 aredisplayed. In addition, information on a program that is broadcast atchannel 8 in a time zone of 5:00 and information on a program that isbroadcast at channel 10 in a time zone of 5:00 are displayed.

In the embodiment of the present invention, on both axes of channel andtime zone, an integer number of blocks are arranged to be displayed.However, the display range of channels is not enlarged, and thus allchannel numbers 1, 3, 4, 6, 8, 10, 12 are displayed. By contrast, thedisplay range of time zones is enlarged, and thus only figures in thetime zones of 4:00 and 5:00 are displayed rather than all the timezones.

FIG. 24 shows a display example of EPG after zooming. In FIG. 24, notonly the display range of time zones but also the display range ofchannels are enlarged. That is, as the display range of the time zones,only figures in the time zones of 4:00 and 5:00, rather than in all thetime zones, are displayed. Also, as the display range of channels, onlyfigures of channels 8 and 10, rather than all the channels, aredisplayed.

As described above, by enlarging the displayed information, a user canaccurately confirm the program information.

FIG. 25 shows a display example of EPG after zooming. If an amount ofzoom manipulation is larger than that in the state as illustrated inFIG. 22, i.e. if a manipulation for enlarging the displayed informationis performed, as shown in FIG. 25, only program information of one blockat channel 10 in a time zone of 4:00 is displayed.

However, if the displayed character is blurred as shown in FIG. 22 in astate in which blurring of the display information is prohibited, anarrower range of channels and time zones is displayed. Also, if thedisplayed character has been made into a mosaic pattern as shown in FIG.25 in a state in which the mosaic patterning of the display informationis prohibited, a wider range of channels and time zones is displayed asshown in FIG. 23 or 24.

[Modifications]

In the above-described embodiments, a television receiver has beenconsidered as the image display apparatus 12. However, it is alsopossible to apply the present invention to a personal computer or otherinformation processing apparatuses.

The series of processing described above may be executed by hardware orsoftware. In the case of executing the series of processing usingsoftware, a program included in the software is installed in a computerprovided in dedicated hardware or installed in a general-purposepersonal computer, which is capable of executing various kinds offunctions when various programs are installed.

Also, a program executed by a computer may be a program that performsprocessing in a time-series manner according to the order as describedabove or may be a program that performs processing in parallel orseparately at any timing when such processing is necessary, for example,in response to a calling by a user.

In addition, in this specification, the system indicates the entireapparatus formed by a plurality of devices.

Also, the present invention is not limited to the above-describedembodiments, and diverse modifications can be made without departingfrom the scope of the invention.

The present application contains subject matter related to thatdisclosed in Japanese Priority Patent Application JP 2009-103828 filedin the Japan Patent Office on Apr. 22, 2009, the entire content of whichis hereby incorporated by reference.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

The invention claimed is:
 1. An information processing systemcomprising: a detection unit operable to detect user input comprisinggestures in three-dimensional space; and an operation unit operable to:set one of a plurality of modes in accordance with user input detectedby the detection unit, the plurality of modes comprising a zoom mode anda pointing mode, if the set mode is the pointing mode, designate anobject based at least in part on user input detected by the detectionunit, if the set mode is the zoom mode, define a zoom rate for zoomingan object based at least in part on user input detected by the detectionunit, determine whether the defined zoom rate causes at least part ofthe object to be blurred, zoom the object at a larger zoom rate that islarger than the defined zoom rate, and cause the object to be displayedat the larger zoom rate, if it is determined that the defined zoom ratecauses at least part of the object to be blurred, and zoom the object atthe defined zoom rate and cause the object to be displayed at thedefined zoom rate, if it is determined that the defined zoom rate doesnot cause at least part of the object to be blurred.
 2. The informationprocessing system of claim 1, wherein the determination whether thedefined zoom rate causes at least part of the object to be blurred isbased on at least one of a number of strokes of a character of theobject, an amount of space between lines of the object, and a distanceof a contour of the object.
 3. The information processing system ofclaim 2, wherein the object comprises an image of a face, the distanceof the contour of the object comprises a distance of a contour of apredetermined region of the face, and the predetermined region of theface comprises a mouth region or a nose region.
 4. The informationprocessing system of claim 1, wherein the larger zoom rate is determinedby recognizing a character, a figure, or a face that is displayed on theobject.
 5. The information processing system of claim 1, wherein thezoom unit zooms a predetermined range based at least in part on avirtual point on a virtual plane to which a reference point designatedvia user input corresponds.
 6. The information processing system ofclaim 5, wherein if end portions in upward, downward, left, and rightdirections of an enlarged range are positioned out of the virtual planewhen the predetermined range around the virtual point is enlarged, theposition of the virtual point in the virtual plane is corrected so thatan image in the virtual plane is enlarged.
 7. The information processingsystem of claim 1, wherein the user input which the detection unit isoperable to detect is represented by a remote control signal generatedby an input device in response to the input device being manipulated bythe user via gestures in three-dimensional space.
 8. The informationprocessing system of claim 1, wherein the detection unit is operable todetect user input comprising hand gestures in three-dimensional space.9. The information processing system of claim 1, wherein the operationunit is operable to enable a user to specify whether blurring of theobject is permitted.
 10. The information processing system of claim 9,wherein the operation unit is operable to: zoom the object at a largerzoom rate that is just larger than the defined zoom rate and cause theobject to be displayed at the larger zoom rate if it is determined thatthe defined zoom rate causes at least part of the object to be blurred,and the user specifies that blurring of the object is not permitted; andzoom the object at the defined zoom rate and cause the object to bedisplayed at the defined zoom rate if it is determined that the definedzoom rate does not causes at least part of the object to be blurred, orif the user specifies via the display condition unit that blurring ofthe object is permitted.
 11. An information processing method comprisingacts, performed by an information processing apparatus, of: enabling auser to select from of a plurality of modes via input comprising one ormore gestures in three-dimensional space, the plurality of modescomprising a zoom mode and a pointing mode; in response to the userselecting the pointing mode, enabling the user to designate an objectvia input comprising one or more gestures in three-dimensional space; inresponse to the user selecting the zoom mode: enabling the user todefine a zoom rate for zooming an object via input comprising one ormore gestures in three-dimensional space; determining whether thedefined zoom rate causes at least part of the object to be blurred;zooming the object at a larger zoom rate that is larger than the definedzoom rate, and causing the object to be displayed at the larger zoomrate, if it is determined that the defined zoom rate causes at leastpart of the object to be blurred; and zooming the object at the definedzoom rate, and causing the object to be displayed at the defined zoomrate, if it is determined that the value defined zoom rate does notcause at least part of the object to be blurred.
 12. The informationprocessing method of claim 11, wherein the determination whether thedefined zoom rate causes at least part of the object to be blurred isbased on at least one of a number of strokes of a character of theobject, an amount of space between lines of the object, and a distanceof a contour of the object.
 13. The information processing method ofclaim 12, wherein the object comprises an image of a face, the distanceof the contour of the object comprises a distance of a contour of apredetermined region of the face, and the predetermined region of theface comprises a mouth region or a nose region.
 14. The informationprocessing method of claim 11, wherein the larger zoom rate isdetermined by recognizing a character, a figure, or a face that isdisplayed on the object.
 15. The information processing method of claim11, wherein zooming the object comprises zooming a predetermined rangebased at least in part on a virtual point on a virtual plane to which areference point designated via user input corresponds.
 16. Theinformation processing method of claim 15, wherein if end portions inupward, downward, left, and right directions of an enlarged range arepositioned out of the virtual plane when the predetermined range aroundthe virtual point is enlarged, the position of the virtual point in thevirtual plane is corrected so that an image in the virtual plane isenlarged.
 17. The information processing method of claim 11, wherein theuser input comprising one or more gestures in three-dimensional space isrepresented by a remote control signal generated by an input device inresponse to the input device being manipulated by the user via the oneor more gestures in three-dimensional space.
 18. The informationprocessing method of claim 11, wherein the user input comprising one ormore gestures in three-dimensional space comprises one or more handgestures in three-dimensional space.
 19. The information processingmethod of claim 11, comprising an act of enabling the user to specifywhether blurring of the object is permitted.
 20. A non-transitorycomputer-readable storage medium having instructions recorded thereonwhich, when executed, perform a method comprising: enabling a user toselect from of a plurality of modes via input comprising one or moregestures in three-dimensional space, the plurality of modes comprising azoom mode and a pointing mode; in response to the user selecting thepointing mode, enabling the user to designate an object via inputcomprising one or more gestures in three-dimensional space; in responseto the user selecting the zoom mode: enabling the user to define a zoomrate for zooming an object via input comprising one or more gestures inthree-dimensional space; determining whether the defined zoom ratecauses at least part of the object to be blurred; zooming the object ata larger zoom rate that is larger than the defined zoom rate, andcausing the object to be displayed at the larger zoom rate, if it isdetermined that the defined zoom rate causes at least part of the objectto be blurred; and zooming the object at the defined zoom rate, andcausing the object to be displayed at the defined zoom rate, if it isdetermined that the value defined zoom rate does not cause at least partof the object to be blurred.